A Benchmarking Methodology for Network Processors

Due to the heterogeneity of network processor architectures and constantly evolving network applications, it is currently a challenge to compare or evaluate network processors. In this paper, we present principles of a benchmarking methodology that aim to facilitate the realistic evaluation and comparison of network processors. A key aspect of our approach is the separation of function, the environment, and the means of measurement within the benchmark specification. We pay particular attention to system-level interfaces and define a normalizing environment to quantitatively compare network processors. Also, we present a set of representative benchmarks and motivate their selection based on a taxonomy of network equipment. Finally, we provide a proof-of-concept of our methodology by specifying and implementing two benchmarks on a network processor.